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Abstract 

In this paper, we study the cooperative robust output regulation problem for linear uncertain 
multi-agent systems with both communication delay and input delay by the distributed internal 
model approach. The problem includes the leader-following consensus problem of linear multi-agent 
systems with time-delay as a special case. We first generalize the internal model design method to 
systems with both communication delay and input delay. Then, under a set of standard assumptions, 
we have obtained the solution of the problem via both the state feedback control and the output 
feedback control. In contrast with the existing results, our results apply to general uncertain linear 
multi-agent systems, accommodate a large class of leader signals, and achieve the asymptotic tracking 
and disturbance rejection at the same time. 


1 INTRODUCTION 

In this paper, we consider the cooperative robust output regulation for linear uncertain time-delay systems 
of the following form: 


Xi{t) = AiXi(t) + §iUi(t - T con ) + EiV(t ), t > 0 

Vi(t) = CiXi(t),t > 0 (1) 

Xi(9) = x i0 (9), 9 G [—T con ,0] 

where Xi(t) G R n , ytit) G R p , and Ui(t) G R m are the system state, measurement output, and control 
input of the i th subsystem, T con > 0 is the input delay, and v(t) G R q is the exogenous signal representing 
the reference input to be tracked or/and disturbance to be rejected and is assumed to be generated by 
the exosystem of the form 


v(t) = Sv(t ), u(0) = vq, t > 0 

where S G R qxq is a constant matrix. 

The regulated output for each subsystem is defined as 

ei{t) = yi(t)-y 0 {t), i = l,...,N, 


( 2 ) 


(3) 


where yo(t) = —Fv(t). 

Let C([—r, 0], R w ) with r > 0 be the Banach space of continuous functions mapping the interval [—r, 0] 
into R w endowed with the supremum norm. We assume Xhj G C([—r cora , 0], R n ). 

The plant ([1J} and © can be viewed as a multi-agent systems with the exosystem © as the leader 
and the N subsystems of © as the followers. The communication topology can be described by a 
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directed graph Q = (V, ffl, where V = {0,1,..., N} is the node set with the node 0 associated with the 
exosystem m and all the other nodes associated with the N subsystems 0, and £ is the edge set. The 
edge (j, i) G £, i ^ j, i,j = 0,..., N , if and only if the control u;, i = 1,..., N, can access the state Xj 
and / or the output yj of subsystem j, j = 0,..., N. If (j, i ) G £, node j is called a neighbor of the node 
i. We use A/i to denote the neighbor set of node i with respect to V. 

Due to the communication constraint and the communication time-delay, we are limited to consider 
the class of distributed control laws with the communication delay. Mathmetically, such a control law is 
described as follows: 

Uj (f ) — k^Zi (t), Zj(t ), Xi (t T com ), Xj (t T CO rn) , j £ A/[) 

Zi{t) =g(zi(t),yi(t - T com ),yj(t - T com ),j <G A/i) (4) 

2;(0) =2io(0), 9 € [—T com , 0], * = 1,..., N 

where Z{ G i?™*, Zio G C([—r com ,0], R n *), k and g are linear functions of their arguments, T com > 0 
represents the communication delay among the agents. The control law © is called a distributed dynamic 
state feedback control law, and is further called a distributed dynamic output feedback control law if the 
function k is independent of any state variable. 

In recent years, the cooperative output regulation problem of multi-agent systems has received ex¬ 
tensive attention pa min [ 20 ]. The problem is interesting because its formulation includes the leader¬ 
following consensus, synchronization or formation as special cases. Like the output regulation problem 
of a single linear system Hi nia, there are two approaches to handling the cooperative output regulation 
problem of multi-agent systems. The first one is called feedforward design [131 [13] . This approach makes 
use of the solution of the regulator equations and a distributed observer to design an appropriate feedfor¬ 
ward term to exactly cancel the steady-state tracking error. The second one is called distributed internal 
model design [13 ng. This approach employs a distributed internal model to convert the cooperative 
output regulation problem of an uncertain multi-agent system to a simultaneous eigenvalue assignment 
problem of a multiple augmented system composed of the given multi-agent system and the distributed 
internal model. The internal model approach has at least two advantages over the feedforward design 
approach in that it can tolerate perturbations of the plant parameters, and it does not need to solve the 
regulator equations. 

More recently, the feedforward approach was further extended to the cooperative output regulation 
problem for exactly known linear multi-agent systems with time-delay [9|. However, since this approach 
cannot handle the model uncertainties and the control law has to rely on the solution to the regulator 
equations, we will further develop a distributed internal model approach to deal with the cooperative out¬ 
put regulation problem of uncertain multi-agent systems subject to both input delay and communication 
delay. 

As a special case of the cooperative output regulation problem, the leader-following consensus problem 
of linear multi-agent systems has been studied in several papers. Some typical references that handle 
the communication time-delay are [J, 0, [12], [13], [14| . 49] . [2T1 and [23 ■ In particular, in [14] , 
the communication time-delays were considered in the leaderless consensus problem for single-integrator 
multi-agent systems under undirected and fixed network topology. In [23] , the leader-following consensus 
problem of double integrator multi-agent systems with non-uniform time-varying communication delays 
was studied under fixed and switching topologies. On the other hand, input delay is also inevitable due to 
the processing and connecting time for packets arriving at each agent [24] . Cooperative control of multi¬ 
agent systems with input delay has been studied in, say, [13], [22, [22 and the references therein. In 
particular, the reference [22 considered the leaderless consensus problem of high-order linear multi-agent 
systems with both communication delay and input delay with directed and fixed network. 

As mentioned before, the problem formulation of this paper is general enough to include the leader¬ 
following consensus problem of general multi-agent systems with both communication delay and input 
delay as a special case. Moreover, by adopting the distributed internal model approach, our control law 
is able to handle model uncertainty, and simultaneously achieve asymptotic tracking and disturbance 
rejection for a large class of signals generated by a linear autonomous system called exosystem. 

Technically, this paper is most relevant to m and m- Specifically, reference m studied a special 
case of this paper with N = 1 in the system ©• For this case, since there is no communication constraint 
on the control law ©, we can use the full state feedback control or the full output feedback control 

1 See Appendix for a summary of digraph. 
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to handle the problem. However, in the current case, we have to employ distributed control law which 
makes the design of our control law much more complicated. On the other hand, reference m treated 
the same problem as this paper for a special case of the system © with T con = 0 by a special case of the 
control law d4j) with r com = 0. However, due to the input delay and communication delay, the proof of 
the main results of this paper is much more sophisticated than the proof of the main results in |17] . We 
have to introduce or establish some specific technical lemmas to establish our main results. 

The rest of this paper is organized as follows. Section [2] gives the problem formulation and some 
preliminaries. A general framework is established in Section [3] Section [3] presents our main results. One 
example is used in Section [5] to illustrate our results. Finally, we close the paper with some concluding 
remarks in Section [21 

Notation. For x, £ R rii , i — 1, ...,?n, col(xi, ■ • • ,x m ) = [x±, ■ ■ ■ ,x'^ n ] T . For any matrix X £ R nxm , 
vec(X) = col(Wi,...,A m ) where X t . i = l,...,m, is the i th column of X. ® denotes the Kronecker 
product of matrices. Let C denote the complex plane. For A £ C, let i?e{A} > 0 denote the real part of 

A. 


2 Problem formulation and preliminaries 

Like in HZ|, all matrices in © can be uncertain. Let Ai = Ai + SiA, Bi = B + SiB , Ei = Ei + SiE , Ci = 
Ci + SiC , where Ai , Bi , Ei , Ci represent the nominal part of these matrices, and SiA , SiB, SiE , SiC are the 
perturbations of these matrices. For convenience, we denote the system uncertainties with a vector 

vec(<5iA,..., SnA) 
vec(S\B ,..., SnB) 
vec(SiE ,..., SnE) 
vec(SiC,..., SjyC) 

Now, we can state our problem as follows: 

Definition 2.1 Linear cooperative robust output regulation problem: given the system 0, the exosystem 
©. and a digraph Q, design a control law of the form © such that the closed-loop system satisfies the 
properties ro and \2.‘2\ as follows. 

Property 2.1 The nominal closed-loop system is exponentially stable when v = 0. 

Property 2.2 There exists an open neighborhood W of w = 0 such that , for any w £ W and any initial 
conditions Xio, Zio and vq, the regulated output lim^oo ei(t) = 0, i = 1,..., N. 

Remark 2.1 It is noted that the problem studied in is a special case of the above problem when 
both the communication delay T com and the input delay T con are zero. The presence of these two delays 
makes our problem formulation more realistic and, as will be seen later , the handling of the problem more 
challenging. 


j^Nn{n+m+p+q) 


For the solvability of the above problem, some assumptions are stated as follows. 

Assumption 2.1 There exist matrices A, B, C such that Ai = A, Bi = B, Ci = C, i = 1,..., N. 
Assumption 2.2 All the eigenvalues of S are on the imaginary axis. 

Assumption 2.3 The matrix pair ( A,B ) is stabilizable. 

Assumption 2.4 The matrix pair (C, A) is detectable. 

Assumption 2.5 For all A £ cr(S), where a(S) denotes the spectrum of S, 


rank 


A- XI n B 
C 0 


= n+p. 


( 5 ) 


Assumption 2.6 The digraph Q contains a directed spanning tree with the node 0 as the root. 
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Assumption 2.7 A has no eigenvalues with positive real parts. 

Remark 2.2 Assumptions [Kj] to \ 2 . 61 are standard ones and they are needed in ins even if there are 
no communication delay and input delay. And Assumption \2. 7| is additional and it is made so that the 
delayed system can be stabilized by using the low gain method introduced in 12$/ . 


3 A general framework 


To construct a specific control law, let A = [ay] £ r( n + 1 )x( n + 1 ) an d £ = g j^(n+i)x(n+i) ^g 
weighted adjacent matrix and Laplacian of the digraph Q, respectively. Let A be an N x N nonnegative 
diagonal matrix whose i th diagonal element is Oio- Then, we have in m 


c = 


0 

OixJV 

— Aljv 

H 


where ljv is an N x 1 column vector whose elements are all 1 and H satisfies Hl^ = Aljv- 

In terms of the elements of A , we can define a virtual regulated output e V i(t) for each follower 
subsystem i as follows: 

e vi {t) = ^2 <Hj(yi(t ) - yj(t)), i = 1,..., N. (6) 

j'eM 

Note that the subsystem e V i(t) can access the regulated error [yfit) — Vj(t)) if and only if the node j is 
the neighbor of the node i. 


Remark 3.1 Let e = col(e\, ..., ejv) and e v = col(e v \, ..., e„jv). Then it can be verified that e v = 
(H ®I p )e. By Lemma 4 ofJ]S or Lemma 1 of m, the matrix —H is Hurwitz if and only if Assumption 
is satisfied. Thus, under Assumntion 1 2 . 61 e v = 0 iff e = 0. 


In order to make use of the internal model principle to handle the systems with input delay and 
communication delay, we need to generalize the concept of the minimum p-copy internal model to the 
following form: 

Definition 3.1 A pair of matrices (G\, G 2 ) is said to be the minimal p-copy internal model of the matrix 
S if the pair takes the following form: 

G 1 = block diag (/?,..., /?), G 2 = block diag (cr,... ,a) (7) 

V v ✓ S. v ✓ 

p—tuple p—tuple 

where /3 is a constant square matrix whose characteristic polynomial equals the minimal polynomial of S, 
and a is a constant column vector such that (/3, er) is controllable. 

Having defined the virtual regulated output e V i(t) and introduced the p-copy internal model, we can 
describe our distributed dynamic state feedback control law as follows: 

Uiit) =K x rji(t ) + K-zfit ) ^ 

Ziifi) — GxZift) T G2e v i(t Xcomfi l — 1) ■ ■ • ; 

where pfit) = YjjeATt a b' ( x * (* 7 com ) Xj (t — T C om )), xq (t) = 0, Zi(t) £ R Hz with n z to be specified 
later, ( K x , K z ) are constant matrices of appropriate dimensions to be designed later, (G 1 , G 2 ) are defined 
in 0, and, respectively, our distributed dynamic output feedback control law as follows: 

Uiit) =KiZi(t) + K 2 fii{t) 

Zi{t) — GxZiit) T G2e v i{t x corn ) ^9) 

ii(t) =A£i{t) + Baft - t) - LCrjift) + Le vi {t - r com ), i = l,...,N 

where £i(t) £ R n , fji(t) = a B te(*) — ; £o(*) = 0, and Zift) £ R Uz with n z to be specified 

later, r = T com + T con , (Ki, K 2 ,L) are constant matrices of appropriate dimensions to be designed later 
and (Gi,G 2 ) are defined in 0. 
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Let x = col(xi,..., xn), z = col( 2 i,..., zn), £ = col(£i, • • •, £n), u = col(wi,..., un), A = blockdiag( A ±, 
...,A n ), B = blockdiag(5i, ..., Bn), E = E^) T , C = (H <g> I p )block diag(Gi, ..., C N ), 

F = (AIjv) <8> F, L = Jjv <S> L, G\ = In <8> G\, G 2 = In ® G 2 . Then, we define an auxiliary system as 
follows: 

x(t) = Ax(t) + Bu(t — T con ) + Ev(t),t > 0 

v(t) = Sv(t),t > 0 (10) 

e v (t) = Cx(t) + Fv(t),t > 0. 


Clearly, the matrix pair (Gi,G 2 ) is the minimal pN-copy internal model of the matrix S. Thus, by 
Definition cm the following system 

z(t) = G\z(t) + G 2 e v (t - T corn ),t > 0 (11) 

is an internal model of (flOl) . The composition of the auxiliary system m and the m is called the 
augmented system of m and is put as follows: 

x(t) = Ax(t) + Bu{t — T con ) + Ev(t),t > 0 
z(t) = G\z(t) + G 2 e v (t - T com ),t > 0 
v(t) = Sv(t),t > 0 
e v (t) = Cx(t) + Fv(t),t > 0. 

Remark 3.2 It can be seen that the internal model in llOj is a special case of dill) by setting T com = 0. 
It is shown in Lemma 1.27 of m that if the matrix pair (Gi,G 2 ) is the minimal p-copy internal model 
of the matrix S, then the following matrix equation 

XS -GiX = G 2 Y (13) 

has a solution X only ifY = 0. This property is the key for establishing the following result. 

The role of an internal model is to convert the output regulation problem of the given plant m 
to the stabilization problem of the augmented system m- To be more precise, we have the following 
lemma. 


Lemma 3.1 Under Assumvtion \2.2l 

(i) suppose a static state feedback control law of the form 

u(t) = K x x{t - T com ) + K z z(t) (14) 


stabilizes the nominal plant of the augmented system (ED- Then, the dynamic state feedback control law 
of the form 


u(t) =K x x{t - T com ) + K z z(t) 
z{t) =Giz(t) + G 2 e v (t - T com ) 

solves the robust output regulation problem of the auxiliary system W- 
(ii) suppose a dynamic output feedback control law of the form 

u(t) =K 1 z{t) + K 2 £(t) 

f(t) =S^(t) + S 2 e v (t - Tcom) + S 3 ((t - r) 


(15) 


(16) 


where f = col(z,f), stabilizes the nominal plant of the augmented system (1121) . Then, the dynamic output 
feedback control law of the form 

u(t) =k lZ (t) + K 2 £(t) 

Z(t) =GlZ(t) + G 2 e v {t - Tcom) (17) 

fit) =Si£(t) + S 2 e v (t - Tcom) + S 3 ((t - t) 


solves the robust output regulation problem of the auxiliary system m■ By R.emark \H.l\. under Assump¬ 
tion 12.61 either of the two control laws also solves the cooperative robust output regulation problem of the 
given plant W- 
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Before giving the proof of Lemma 13.11 we still need some remarks. First, under the coordinate 
transformation z(t) = z(t — r com ),£(f) = £(i — r com ), the closed-loop system composed of system (flOl) 
and m or ED can be put into the following form: 


&c(t) — ^ ^ A CW jX c (t ^~i) H - B cw v(t) 


2 — 0 
1 


^ ^ CcyjiX c {t 7~i) -\~ D cw v(t) 

2 — 0 

v(t) = Sv(t) 

where fo = 0, f\ = r, under the dynamic state feedback, x c = col(x, z), and 


A C wO — 


Br.ii) — 


A 0 
G 2 C Gi 


A i - 

5 -n-CWl — 


BK X BK Z 

0 0 


( g E 2 f ) • Cc "° = < e 0 ) 


C cw 1 = ( 0 0 ) , D cw = F 

and, under the dynamic output feedback, x c = col(x, z, £), and 


lewO 


A 

0 

0 \ 


( ° 

BK 1 BK 2 \ 

G 2 C 

G i 

0 

5 AqwI — 

° 

° 

S 2 C 

0 

Si ) 


V o 

% ) 


(18) 


B cw = ( G 2 F J , C cw0 = ( C 0 0 ) 

V S 2 F ) 

C C wi = ( 0 0 0 ), D cw = F 

Remark 3.3 It can be deduced from Lemma 2. 1 0 f ms, under Assumvtion \2.2l if the closed-loop system 
(El satisfies Property V2.1\ then, for each w £ W, and any matrix B cw of appropriate dimension, there 
exists a unique matrix X cw that satisfies the following matrix equation: 


X c yj s = E Acwi-^-c 


n-Sfi 


Bril) • 


(19) 


2—0 


Moreover, by Lemma 2.2 of ms . under Assumvtion \2.2l if the controller (1151) or (1171) renders the closed- 
loop system (1181) Provertu \2.1l then, the same controller solves the linear robust output regulation problem 
if and only if, for each w £ W, there exists a unique matrix X cw that satisfies the following matrix 
equations: 


X CW S — ^ ) A CW iX c 


i=0 
1 


0 = ^ C cwi x c 


-Sn 


J~Sfi 


B r 


( 20 ) 


i=0 


Now, we will give the proof of Lemma T3. II as follows. 

Proof: Note that the closed-loop system (fTSl) can also be viewed as a composition of the augmented 
system m and a static state feedback control of the form u(t) = K x x(t — T com ) + K z z(t) (respectively, a 
dynamic output feedback control law of the form u(t) = Kiz(t)+K 2 £(t),£(t) = Si£(f) + S 2 e v (t — r com ) + 
S 3 <;{t — r), where ( = col(z,£)). Thus, the closed-loop system (fl8l) satisfies Property 12.11 By Remark 
13.31 under Assumption 12.21 it suffices to prove that the matrix equations (ED have a unique solution X cw 
under either the static state feedback controller or the dynamic output feedback controller. In fact, by 
Remark 13.31 the first equation of (T2U1) has one unique solution X cw . Thus, we only need to prove that 
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X cw also satisfies the second equation of COl) . We will do so for the static state feedback control case 
and the dynamic output feedback case, respectively. 

X„ 


Part (i): Let X cw = 
form: 


where 


with X w £ R Nnx i anc j ex p anc j the first equation of (12011 to the following 

( 21 ) 


X W S =Ax w + B(K x X w + K z Z w )e~ ST + E 
Z W S =G\Z W + G 2 Y w 


Y w = CX W + F. 


( 22 ) 


Since the second equation of m is in the form da, by Remark 13.21 Y w = 0. That is, X cw also satisfies 
the second equation of (20). 

Part (ii): Let X cw = ^ ^ with X w £ R NnXq , and Z w £ Partition Z w to Z w = 

( 7 ” ) > w here Z w £ R Nn ^ x i with Nn z the dimension of G\. Then, it can be verified that, under the 

control law u(t) = K\z(t) + k 2 at),i(t) = Si£(t) + S 2 e v (t — r com ) + S 3 at — r), where ( = col(z,£), the 
first equation of GUI) can be expanded to the following form: 


X W S =AX W + B(K 1 Z W + K 2 Z w )e~ ST + E 

Z W S =G\Z W + G 2 Y w 

Z W S =S\Z W + S 2 Y w + SsZ w e St 


(23) 


where 

Y w = CX W + F. (24) 

Since the second equation of (E3l) is in the form (fl3l) . by Remark 1X^1 Y w = 0. That is, X cw also satisfies 
the second equation of m- n 

Remark 3.4 In order to apply Lemma, \H.1\ to our problem, it is not enough to show that the nominal 
part of the augmented system (HI is stabilizable by a static state feedback control law of the form 0 or 
a dynamic output feedback control law of the form fH). We actually need to show that the nominal part 
of the augmented system m is stabilizable by a distributed static state feedback control law of the form 
Ui(t) = K x rii(t) + K z Zi(t), i = 1,..., N (or a distributed dynamic output feedback control law of the form 
Ui(t) = K\Zi{t) + K 2 fji(t),ii(t) = Si£i(t) + S 2 e vi (t - T com ) + S 3 (i(t - t) + Siffiit) + S 5 fji(t - t), where 
£i = col(zi,fi), i = 1,..., N). As a result, the distributed state feedback control law (0) ( or the distributed 
output feedback control law W) solves the cooperative output regulation problem of the system W- What 
makes this stabilization problem much more challenging than the problem in m is that the augmented 
system m is subject to both input delay and communication delay. We need to first establish a few 
lemmas to lay the foundation of our approach. 


4 Main result 


To establish some Lemmas in this section, we need to first cite the following lemma. 
Lemma 4.1 (Lemma 3.2 in JVj) Consider the system 


at) = M 0 at)+ M *<(* - A*)+ xat) 


m = Co(0), 0 e [—A, o] 

where Mi £ R nxn , i = 0,1,... ,p, N £ R nxm are some constant matrices, 0 < Ai < A 2 < ■ ■ ■ < A p = A 
are arbitrary time-delays, Co £ C([—A, 0], R n ), and C(i) is any measurable, essentially bounded function 
over [0, oo). Assume that the origin of the unforced C(t) system is exponentially stable and lim^oo £(t) = 
0. Then, lim^oo £(i) = 0. Moreover, lim^oo £(t) = 0 exponentially if lim^oo £(t) = 0 exponentially. 
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Lemma 4.2 Suppose that Assumptions 12.31 12.51 and \2.7\ are satisfied. Consider the system of the 
form 

Xi(t) = Axi(t) + \iBui(t — t), i = l,...,N (26) 

where Xi £ Ri n+n A , m £ R m , A = ^ Q~Q Q ^ , B = ^ B ^, and At £ C with Re{Ai\ > 0. Then, 

there exists a matrix K £ R rnx ( n + n A such that the state feedback control law ufit) = Kxfit), i = 1,..., N, 
asymptotically stabilize all subsystems of the system (l26l) . 

Proof: Under Assumptions 12.21 12.31 and 1^31 by Lemma 1.26 of 0, {A, B) is stabilizable. Moreover, under 
additional Assumption 12.71 we have that A has no eigenvalues with positive real parts. Therefore, there 
exists a nonsingular matrix T such that 

a = T at-' = ( a 0 ‘ X)- s = TB= (ft) (27) 

where all the eigenvalues of the matrix A 2 have negative real parts, all the eigenvalues of the matrix Mi 
are on the imaginary axis and (Mi, 61 ) is controllable. Then, system (l26l) is equivalent to the following 
system: 


Xn{t) =AiXn{t) + AiBiUi(t - t) 

Xa(t) =A 2 Xi2{t) + A iB 2 Ui{t - t), i = 1,..., N. 


By Lemma 1 of EH, there exists a matrix K\ = —v- { 1 BjPe AlT , where iq £ R satisfies 

0 < v\ < Re(Ai), i = 1,..., N, (29) 

and P is the positive definite solution of the ARE 

MfP + PMi -PSi 6 fP = - 7 P (30) 

with some sufficiently small 7 > 0 such that, for i = 1,...,7V, the systems x.n(t) = AiXa(t) + 
AiBiKiXnit — t) are all asymptotically stable. 

Let K = {K i,0). Then, under the control law Ui(t) = Kxi(t), the closed-loop system of (I251l is as 
follows. 

Xu(t) =AiXn(t) + AiB\KiXn(t - t) 

Xi 2 {t) =A 2 Xi 2 {t) + AiB 2 Kixn{t - r), i = l,...,N 

Since for i = 1 ,... ,N, xn(t) subsystem is asymptotically stable, by Lemma 14.11 for i = 1 
Xait) subsystem is asymptotically stable. The proof is thus completed with K = KT. □ 


Lemma 4.3 Consider the system of the form 

x(t) = ( In ® A ° Wi)+f H ® B lN ® B \u(t-r) 

cK ) \H®G 2 C I n ®G 1 ) Xc[t) + { 0 NnzXNm 0 Nn , xNm ) Uc[t T) ( 32 ) 

x c (9) =x c0 (Q), 6 £ [ t , 0 ] 


where x c £ R Ar ( ra + n *) ) u c £ R 2Nm , ( G\,G 2 ) is the minimal p-copy internal model of S as defined 
in |2l), and x c q £ C([—r, 0] , R N ( n + n A^. Then, under Assumvtions 1 2.2\ 1 2.31 12.51 and \ 2. 7\ there ex¬ 
ist matrices K x £ R mxn and K z £ R mxriz , such that under the state feedback control law u c (t ) = 


I In ® R-x 0 NmxNn z 
\ OjVmxiVn In®Kz 
satisfied. 


x c (t), system (13^1) is asymptotically stable if and only if Assumvtion 12.61 is 


Proof: (If Part:) Denote the eigenvalues of H by Ai, i = 1,..., N. Under Assumption l2.61 by Remark l3.ll 
for i = 1,..., IV, Aj have positive real parts. Let Ti be the nonsingular matrix such that Jh = P HTfi 1 is 


in the Jordan form of H. Let T 2 = 
by the following system: 


Ti <g> I n 0 
0 Ti <g> I n 


x c (t) = 


I N ® A 0 
Jh ® G 2 G In ® G 1 


x c {t) 


and x c (t) = T 2 x c (t). Then, x c (t) is governed 

J h ®B I n <8> B \ ,= 

n n T 2 u c (t - r) (33) 

vNn z xNm 'JNn z xNm J 


where T 2 


/ I„ 0 
0 Ti (g) 

Denote u c = col(u c i,..., it c jv) with u ci G R 2m . Partition I N ( n +n z ) as lN(n+n z ) = ( M i , ■ ■ ■ , Qi 

,..., Qjf) T , where M, e (*(»+".)) an d Q, G #«*x(iv („+«*)) and j 2JVm as j 2JVm = (ff, 

, . . . , Qjf ) T , where G R™x( 2 Nm) and e R mx( 2 Nm)_ 

Let T 3 = , Qf, Mj, , Mjy, Qj^) T , x c = T 3 x c and f c = col(i c i,..., i c jv). Then, the system 

becomes a lower triangular system whose diagonal blocks are of the form 


•Xci(G) — 


A 0 
XiG 2 C Gi 


Xci (^) 


A iB B 

On z xm On z xm 


Uci(t -t), i = 1 ,..N 


(34) 


where x ci G R ( - n+n ’\ u ci G R 2m , u c = col(u c i,..., u c n), u c = T 3 T 2 u c , and T 3 = (M[, Qf, Mf, Q%,... 
,MT,Q T N ) T . 

Let T\i = ( ™ \-? r ) j and Xciit) = I\iX c i{t). Then, we get, for * = 1,... ,N, 


0 At 1 /,.. , 

X c i (f ) — 


A 0 
G 2 C Gi 


X ci (t) T A i 


B B 
0 0 


TiiUciit - T ) 


(35) 


where 


/ 0 
0 A- 1 4 

Consider the system of the form 


i(t) = 


A 0 
G 2 G Gi 


Xciify T A^ 


0 


i(t — t), i = 


(36) 


where x C j G R^ n+n A and Ui G R m . 

By Lemma T4.21 there exists a matrix K = ( K X ,K Z ), where 7G G R mxn and K z G R mxn * such that 
the state feedback control law v,i(t) = Kx ci (t), i = 1,..., N, asymptotically stabilize the system (l36l) . 
Since 


B B 

bn z xm On^xm 


)( K i IH *■> 


we have T^Udit) = 


0 

0 /G 

ci(*) =G 


Gi(i)- Thus, 


-1 

4i 


_rp-l 

— 1 4i 


K x 0 
0 K. 

K x 0 
0 K. 

Im 0 
0 A ilm 

K x 0 
0 K 


x C i(t) 

I'kiXci (f ) 

K x 0 
0 K z 


0 X~ 1 I Uz 


Xci (t) 


Xci (t) ■ 
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Let K = 


K x 0 
0 K z 


. Then, we have u(t) = (In <8> K) x c (t). Furthermore, since u c = T 3 T 2 u c , 


x c = Tsx c and x c (t) = T 2 x c (t), we have 

u c (t) =ff 1 ff 1 u c 

=f^f^ ( I N <g> K) x c (t) 
=T 2 - 1 T 3 - 1 ( I N ® K) T 3 T 2 x c (t) 


=t: 


p-\ ( In ® Kx 


0 


_ / T x 1 ® K 


0 

/at < 8 > AT 

0 


T 2 x c (t) 


0 Tf 1 <g> J„ 

/at ® A'j; 0 

0 /at ® AT 2 


/at <S> K x 

0 


0 

/at <g> AT 


Ti ® /„ 


0 

Ti ®/„ 




=(*) 


The proof of the if part is then completed. 

(Only if Part:) Suppose the digraph Q does not satisfy Assumption 12.61 Then, by Lemma 1 of [To] , 
H has at least one eigenvalue at the origin. Without loss of generality, we assume that A; = 0. Then, by 

(El 

Xd(t) = (^ o Gi ) £cl ^ + ( 0 0 ) “ T ) ( 37 ) 

Since the eigenvalues of Gi coincide with those of S, under Assumption ^. 21 the system El and hence the 
system (13T1) cannot be asymptotically stable regardless of the choice of K. The proof is thus completed. 
□ 

Now, we are ready to present our result under the state feedback control law. 


Theorem 4.1 Under Assumptions \K7\ to \2.!A \2.5\ and \ 2. 7] there exist matrices K x £ R mxn , K z £ 
R rnxn * cooperative robust output regulation problem is solved by the distributed dynamic 

state feedback control law © with (Gi,G 2 ) being the minimal p-copy internal model of S if and only if 
Assumvtion \2.6\ is satisfied. 


Proof: Performing the coordinate transformation Zi(t — T com ) = Zi(t), the state feedback control law © 
becomes as follows: 


Ui(t) =K x rji(t) + K z Zi(t - T com ) 

Zi(t) =G\Zi(t) + G 2 e vi (t), i = l,...,N. 


(38) 


Then, under the state feedback control law (1351) . the undisturbed nominal closed-loop system is in 
the following form: 


/ I N ® A 0 A / H®B I N ® B \ 

\H®G 2 C I n ® G 1 ) XcW + ^ 0 Nn , xNm 0 Nn z xNm ) 

x( In ® K * ° r NmxN ^ x c (t - t) 

V ONmxNn In®K z J 


(39) 


where x c = col(x, z) with x = col(a:i,... ,Xn), z = col(zi,..., zn) and K x £ R mxn , K z £ R mXTlz . 

By Lemma EE© there exist matrices K x £ R mxn and K z £ R mxn * ; such that system El is asymp¬ 
totically stable. The proof is thus completed by invoking Lemma 13.11 □ 

To study the output feedback case, we need the following lemma. 


Lemma 4.4 Consider the system of the form 


( In ® A 0 0 

x c (t) = ( H®G 2 C I n ® Gi 0 

\ H®LC 0 I n ®A-H®LC 

x u c (t - t) 

x c (6) =x c0 (9), 0 £ [—r, 0] 


x c (t) + 


0 I N ® B H ®B 
0 0 0 
0 I N ® B H ®B 


(40) 
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where x c G R N (2n+n z ) ^ g R 3Nm , (Gi,G 2 ) is i/ie minimal p-copy internal model of S as defined in 
0, and x c o 6 C([-r, 0] ,R N ( 2n+n A). Then, under Assumvtions \2.2[ HOI \2.f\ \2.5\ and \2.1\ there exist 
matrices K\ G R mxn *, K 2 G R mxn and L G R nxp , such that under the state feedback control law 

In ® K 2 0 0 

0 In ® K\ 0 
0 0 In ® K'2 

and only if Assumvtion l^fR is satisfied. 


u c (t) = Kx(t), where K = 


, system PH) is asymptotically stable if 



Proof: Let T = 


In ® A 0 
x c (t)=\ H®G 2 C I n ® G\ 


and x c =Tx c . Then, the system TO becomes 


0 


0 


0 
0 

I N ® A - H ® LC) 


(H ®B I N ®B H ®B\ 

= (f)+ 0 0 0 T u c (t-r) (41) 

\ 0 0 0 J 


where T = 


iNm 0 0 

0 INm 0 

In m 0 In m 

Denote x c = col(x c i, x c2 ) with x c \ G R N ( n + n A and x c2 G R Nn . Then, by Lemma fOl under Assump¬ 
tions [HEIES] and IT71 there exist matrices K\ G R mxn * and K 2 G R mxn , such that under the state 

In ® A 2 0 


feedback control law u c i(t) = Kx c i(t), where K = 


0 


In <8> K i 


x c i(t) = 


I N ® A 0 

H®G 2 C I n ®G 1 


x cl (t) 


H ®B I N ®B 

0 0 


, the following system 

u c i(t-T ) (42) 


is asymptotically stable if and only if the digraph satisfies Assumption 12.61 Thus, the only if part has 

/ In ® K 2 0 0 

been proved. To show the if part, let K = I 0 In ® Ki 0 

\ 0 0 In <S> K 2 

feedback control law u c (t) = T~ 1 Kx c (t), the closed-loop system of (TUI) is as follows: 


. Then, under the state 


x c i(t) = 


I N ® A 0 
H®G 2 C I n ® Gi 

In ® A 2 0 

0 In ® A i 

tc C 2 (t) =(In ® A- H ® LC)x c2 (t). 


x c i{t) - 
x c i{t ~t) + 


H ®B I N ®B 

0 0 


H®B 

0 


(I N ® I< 2 )x c2 (t - t) 


(43) 


where x c = co\(x c i,x c2 ). We first note, from the proof of Theorem 2 of [17], that, under Assumption 12.41 
there exists a matrix L such that the matrix (In ® A — H <g> LC) is Hurwitz. Moreover by Lemma T4.31 
the x c i subsystem with x c2 setting to zero is asymptotically stable. Thus, by Lemma I7TT1 system (TI51) is 
asymptotically stable. Furthermore, since x c (t) = Tx c (t ), we have 

u c (t) 

=T~ 1 Kx c (t) 

=T~ 1 KTx c (t) 


Intu 

O 

O 

(In ® AT 2 

0 

0 

0 

Inttl 0 1 

° 

In ® Ki 

0 

Intu 

0 iNm ) 

V 0 

0 

In ® K 2 

In ® 

k 2 0 

0 \ 



0 

In ® Ai 

0 

x c (t ) 


0 

0 

In ® K 2 ) 





x c (t) 


(44) 


=Kx c (t) 

The proof is thus completed. 


□ 
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Theorem 4.2 Under Assumvtions \2.1\ to \2.5\ and there exist matrices K\ £ R mxriz , K 2 £ Jj mxn 
and L £ R nxp such that the cooperative robust output regulation problem is solved by the distributed 
dynamic output feedback control law © with (Gi,G 2 ) being the minimal p-copy internal model of S if 
and only if As sumption\2jj\ is satisfied. 


Proof: By introducing the coordinate transformation £j(t — t coto ) = £*(£), Zi(t — T com ) = Zi(t), the 
distributed dynamic output feedback control law © becomes the following form: 

V.iif ) —KiZift T corn ) A- K2'hi(f Tcom)i l — 1)■• • j N 

Zi(t) =G\Zi ( t ) + G 2 e vi (t) (45) 

|i(t) =A£i(t) + Built - T con ) - LCfji(t) + Le vi (t) 

where = EjeA/i a H (&(*) “ &(*))• 

Then, under the output feedback control law (USD, the undisturbed nominal closed-loop system is in 
the following form: 

l I N ® A 0 0 \ / 0 

x c (t) = [ H®G 2 C In®Gi 0 ) x c (t) + [ 0 

\ H®LC 0 I N ® A- H ®LC ) \ 0 

/ In ® R-2 0 0 \ 

x | 0 In ® K\ 0 I ar c (t — r) 

\ 0 0 In ® R-2 ) 

where x c = col(:r, z,£) with x = col(a:i,... ,Xn), z = col(5i,..., Zn) and 

By Lemma WM there exist matrices K t £ R mxn *, K 2 £ R mxn and L £ R nxp , such that system (HS1) 
is asymptotically stable. The proof is thus completed by noting Lemma 13.II □ 


I N ® B H ®B 
0 0 
I N ®B H ®B 


(46) 


£ = onM A t'lvrl 


Remark 4.1 It is known that the cooperative output regulation problem includes the leader-following 
consensus problem as a special case mm- By the same token, the results of this paper lead to the solu¬ 
tion of the the leader-following consensus problem of multi-agent systems with time-delay as special cases. 
It is noted that, in & and JMEf, the leader-following consensus problem of double integrator multi-agent 
systems with time-varying communication delays were studied under both fixed and switching communi¬ 
cation topology. However, the control laws proposed in and \25^ need to use the speed information 
of the leader. Additionally, our results allow the plant to be uncertain, the dynamics of the leader to be 
different from the followers’, and can reject the external disturbances. 


5 Example 

In this section, we will illustrate our approach using the following uncertain system with input time-delay: 

v(t), t > 0, 


xiit) = 1 ; q ’ 11 j Xi {t) + ^ 7 j Ui(t - r con ) + 

e%{t) = ( 1 0 ) Xi(t) - ( 1 0 ) v(t),i = 1,2,3,4, 
with the exosystem as follows: 

' 0 1 


0 0 
0 i 


v(t) = Sv(t) = 

The nominal system matrices are A = 


0 0 
B = 


j(t). 


(47) 


(48) 


Ei = 


0 0 
0 i 


i = 1,2,3,4, G = 


s ;>*-(: 

(l 0 ), .F = ( — 1 0). The input delay T con = 0.5s. Here, Xu and Xa can be viewed as the position 

and velocity of the i th agent respectively and can be viewed as the tracking error of the position of the 
i th agent. The communication network topology is described in Figure [T| The matrix H associated with 


digraph Q is H = 


/ 2 -i 

0 

0 \ 

0 1 

0 

0 

-1 0 

1 

0 


-1 

3 / 


and the eigenvalues of H are {3,1, 2,1}. 
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It is easy to verify that Assumptions 12.11 to 12.71 are satisfied. Therefore, by Theorem 14.11 and 14.21 the 
cooperative robust output regulation problem for this example can be solved by the distributed controllers 
of the form ([8]) and ©, respectively. 

(1) Distributed dynamic state feedback control 

The distributed dynamic state feedback controller is given as 


Ui(t) =K x r]i(t ) + K z Zi(t ), 

+ G2&vi(j' Tcorn)’) ^ 1 ? • • * 5 ^ ? 


with 


G 1 = 


0 1 
0 0 


Assume the communication delay r com = 0.5s. 


Denote A c = 


A 0 
G 2 C Gi 


and B c 


n 

o 


and G 2 = 


By Lemma I4T21 the desirable feedback gain is 


(49) 


(50) 


K = (K X ,K Z ) = -v^BjPe^ 

where t = 1 and P is the positive definite solution of the parametric ARE 

A T C P + PA C - PB c BjP = - 7 P 


(51) 

(52) 


where 7 is some sufficiently small positive number. 

Figure [2] shows the tracking error e{t) tends to zero asymptotically where the system uncertainties 
are w = (0.05,0.03,0.05,0.01,0.02,0.08,0.05,0.04) T , = 1 and 7 = 0.1. 



Figure 2: The tracking error e(t) under distributed dynamic state feedback control 

(2) Distributed dynamic output feedback control 

The distributed dynamic output feedback control law is given as 

Ui(t) =K\Zi{t) + K 2 fji(t), i = l,...,N 

Zi{t) =G 1 z i {t) + G 2 e V i(t - T com ) (53) 

ii{t) =Mi(t) + Bui(t - r) - LCf]i(t) + Le vi {t - r com ) 
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with (Gi,G 2 ), (Ki,K 2 ) = (K Z ,K X ) defined in (1501) and (I5T1) . respectively. Let v 2 = we have L T = 
i , 2 1 CP , where P is the solution of the Riccati Equation 

AP + PA t +I n - PC T CP = 0. (54) 

Choosing 7 = 0.1, Figure [3] shows that the distributed dynamic output feedback controller solves the 
linear robust cooperative output regulation problem successfully. 



Figure 3: The tracking error c(t) under distributed dynamic output feedback control 


To close this section, we note that this example cannot be handled by any existing methods. 

6 Conclusion 

In this paper, we have studied the cooperative robust output regulation problem of linear multi-agent 
systems by the distributed internal model approach, which includes the leader-following consensus prob¬ 
lem as a special case. A distinguished advantage of the distributed internal model approach over the 
distributed observer approach in [5] is that it allows the plant parameters to be uncertain. To our knowl¬ 
edge, this is the first paper to handle the consensus problem for linear uncertain multi-agent systems 
with both the input delay and communication delay. Our approach can also be extended to the systems 
containing multiple input time-delays and state time-delays. 
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